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Abstract 

We develop further ideas on how to construct low-dimensional 
models of stochastic dynamical systems. The aim is to derive a con- 
sistent and accurate model from the originally high-dimensional sys- 
tem. This is done with the support of centre manifold theory and 
techniques. Aspects of several previous approaches are combined and 
extended: adiabatic elimination has previously been used, but centre 
manifold techniques simplify the noise by removing memory effects, 
and with less algebraic effort than normal forms; analysis of associated 
Fokker-Plank equations replace nonlinearly generated noise processes 
by their long-term equivalent white noise. The ideas are developed by 
examining a simple dynamical system which serves as a prototype of 
more interesting physical situations. 
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1 Introduction 

Centre manifold theory is increasingly recognised as providing a rational 
route to the low-dimensional modelling of high-dimensional dynamical sys- 
tems. Applications of the techniques have ranged over, for example, triple 
convection Q, feedback control ||, economic theory [|], shear dispersion 



11], nonlinear oscillations [22], beam theory [JH|, flow reactors 0, and the 
dynamics of thin fluid films []19f| . New insights given by the centre mani- 
fold picture enable one to not only derive the dynamical models, but also 
to provide accurate initial conditions |15|, ||, boundary conditions |L7|], and, 



particularly relevant to this paper, the treatment of forcing |7|]. 

The above developments have all taken place in the context of determin- 
istic dynamical systems. However, in practice, we want to apply the same 
concepts in a noisy environment. Just one example of interest is the along- 
stream dispersion of a contaminant in a turbulent river — the turbulence can 
only reasonably be modelled by utilising stochastic factors. Thus it is vi- 
tal that we address the problem of constructing low-dimensional models of 
stochastic differential equations (sdes) using centre manifold ideas and tech- 
niques. 

Boxler || has put the subject on a firm base by proving the existence of 
centre manifolds for SDEs. Further, these are proven relevant as models for 
the full system; for example the reduced system of evolution equations do 
indeed predict the stability of a degenerate fixed point. However, the analysis 
is very sophisticated and the results, as seen in the given examples, involve 
infinite sums which seem impractical in most applications. In Sections 
and |H we show how to straightforwardly construct simpler versions of such 
centre manifolds. 

Earlier work by Schoner & Haken |]20| , used the concepts of slav- 
ing and adiabatic elimination to develop one approach to constructing low- 
dimensional models of SDEs. Their analysis initially appears very similar, in 
Section |2] we derive exactly equivalent results, but there are useful improve- 
ments through the centre manifold viewpoint. One immediate benefit, in 
direct contrast to more traditional methods such as that of multiple scales, 
is that one can be much more flexible about the ordering of various effects in 
the model. Another is that we present the analysis much more cleanly as an 
algorithm rather than a hierarchy of formulae; one that can be easily adapted 
f?|, §5] to the vast majority of problems where it is inconvenient to change 
basis in order to separate the "master modes" from the "slave modes." 
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Further, the work of Cox & Roberts [0, [Uj showed how to use flexibility 
inherent in the centre manifold approach to remove memory effects of time- 
dependent forcing from the evolution on the centre manifold (the forcing is 



then purely local in time), unlike the approach of Schoner & Haken [2(J [21 



However, only the leading order effect of the forcing was considered. In a 
separate line, and following the work of Coullet et al @ , Sri Namachchivaya 
& Lin [|L| used the techniques of normal form coordinate transformations, to 
show how to extract a low-dimensional stochastic centre manifold. The nor- 
mal form transformation has the same flexibility recognised by Cox & Roberts 
and consequently also demonstrates the simplification in the evolution that 
may be attained. Thus, in Section [3] we naturally extend the approach of Cox 
& Roberts M to significantly simplify the models of Schoner & Haken PO 



In large, physically interesting problems, dimensional reduction is achieved 
via the approach described herein with much less algebra than is needed by 
the normal form approach. 

Lastly, preceding authors have presented their results in terms of noise 
processes that have the same short-time scale of the transients that we set out 
to eliminate by the modelling. This is inconsistent. Instead we propose that 
the irreducible noise processes in the model should be further simplified by 
only considering them on the long-time scale of the centre manifold evolution. 
This is obtained, Section f|, from a centre manifold analysis of the Fokker- 
Planck equation for a noisy dynamical system. However, as also pointed out 
by Sri Namachchivaya & Lin [O, Knobloch & Wiesenfeld's [TIJ centre man- 
ifold analysis of Fokker-Planck equations needs to be made more systematic. 
For the relatively simple SDEs arising here, the analysis is straightforward 
and may be computed to high-order. We deduce that these noises may be 
replaced by appropriately chosen drift and white noise terms. 

In summary, in this paper we bring the above separate threads together. 
We show how to combine the best features of each to develop an efficient 
and practical approach for low- dimensional modelling of dynamical systems. 
The ideas are developed within the context of a simple modelling problem. 
We do this to pinpoint what is achieved and what needs to be done, without 
obscuring the issues with complicating algebraic generalities. 

Throughout, we adopt the Stratonovich interpretation of SDEs. 



Chao & Roberts 



15 July, 1996 



4 



2 Direct reduction 

In this section we demonstrate that the standard form of the algorithm to find 
a forced centre manifold, as derived by Cox & Roberts 0, when extended 
to higher order in the forcing amplitude and applied to Stratonovich SDEs 
produces the same results as obtained by Schoner & Haken [^(J using the 
slaving principle (the similarity in the basic approaches has previously been 
commented on, for example by Wunderlin & Haken ||23|| ). However, as in the 
method of normal forms §4.2] and unlike simpler methods, the centre 
manifold approach easily caters for nilpotent linearisations (for example, the 
smallness assumption on the linearisation of the master modes of the slaving 



principle, that A u ~ 5 in (3.2) of [20], is unnecessarily restrictive), and is 



readily generalised to construct accurate invariant manifolds |Tj|. Further, 
the great advantage the centre manifold approach has over the normal form 
procedure of Sri Namachchcivaya & Lin [|l^, §4.2] is that one need only com- 
pute the low-dimensional centre manifold; unlike normal form calculations, 
no algebra is done to describe the uninteresting details of the large number, 
possibly infinite in number JTI], [19], e.g.], of exponentially decaying modes. 

The dynamical model we develop in this section provides basic results for 
later comparison and improvement. 

2.1 Formal elimination near a pitchfork bifurcation 

Consider the following example SDE discussed by Schoner & Haken [|20], §5] 

dx = (ax — axy)dt + F x dW\ , (1) 
dy = (-(3y + bx 2 )dt + F y dW 2 , (2) 

where W\ and W 2 are independent Wiener processes, and a, (3, a and b are 
real constants (with a and b having the same sign). In the absence of the 
stochastic forcing this dynamical system undergoes a pitchfork bifurcation as 
the parameter a crosses 0; here we may be interested in investigating effects 
upon the bifurcation of the additive noise. 

Near the bifurcation, for small a, x(t) evolves slowly whereas y(t) decays 
exponentially to zero. Thus x is the order parameter and y the slaved process. 
More rigorously, we append the dynamical equation da = Odt and claim that 
Theorem 6.1 of Boxler J|] asserts that there exists a local stochastic centre 
manifold for (|T]-Q) of the form y = h(t, x, a) for x and a small enough. 
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Thus we assume the stochastic centre manifold (scm) is 

y = h(t,x), (3) 

where the dependence upon a is implicit, and where we take the slaved 
variable to explicitly depend on only two variables: time; and the order 
parameter x. Schoner & Haken |2U], Eq.(2.1)] instead used many variables, 
y = h(t, x, Z u ), where Z u (t) denotes a large number of as yet unknown noise 
processes which appear in the low- dimensional model. Here we considerably 
simplify the algebra by including, albeit implicitly, the effects of such noise 
through the time variable t. Consequently, integrals with respect to time are 
performed treating X clS 8b constant, but integrating any noise. 
Differentiate (H) with respect to t to 

Oh Oh 

dy = ~0t dt + 0x dx ' ^ 
Substituting ([§), (0) is written in the following form: 





—dt + pidt 
Ot 



Oh 

h = bx 2 dt + F v dW 2 - —dx . (5) 

Ox 



Substituting for dx from ([[]) we obtain: 

Oh 

Bh = bx 2 dt + F y dW 2 - — [(ax - axh)dt + F x dWi] , (6) 

where 



B= —dt + pidt. 
Ot 

This equation is to be solved for h, the SCM, albeit approximately. 
In the following we solve a sequence of problems of the form 

Bg = hdt + f 2 dW , (7) 

where f\(t,x) and f 2 (t,x) are known functions, and we need to determine 
the process g(t,x). We may deduce |]20|, Eq.(2.20)] 

g = * (hdt + f 2 dW) = f e-#*- r > {f x dr + f 2 dW(r)) , 

where denotes the given convolution. Note these convolution integrals 
are done keeping x constant as that is implicit in the notation 0/0t of time 
differentiation, whereas all noise processes appearing in the integrand must 
be integrated. 
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2.2 Asymptotic solution 

To simplify the solution procedure we define 5 to be 



5 2 



+ \FJ + \FJ + Id 



so that 5 is a quantitative measure of the overall size of the solution and 
contributing terms. In effect, for small 5 the following scaling relations hold: 



x = O (8) , a, F x , F y are O (<5 2 ) , 



whereas the other constants are of order in 5. In principle, the centre man- 
ifold formalism allows us to expand the solution in terms of the parameters 
independently. However, as discussed in [jl4| , by using one ordering param- 
eter 5 we obtain the same set of terms, it is just that they appear in the 
asymptotic expansion in a regimented order. Thus we expand 



h ~ £ h(m) (^ 



m=2 



where contains all terms of order m in S. Substituting into 
obtain 



(8) 



we 



m=2 



x) ~ bx 2 dt + F y dW 2 
* dh im) 



-axf^ h {m) dt + F x dW 1 



m=2 



(9) 



Extracting all terms of order m = 2, 

h {2) (t, x) = ZT 1 [bx 2 dt + F y dW 2 
~ m - \bx 2 dt + F v dW 2 



e r ~ -k 
b 



(10) 







x 



where 



Z (2) (t) = f e-^- T) dW 2 (T) = e- pt *dW 2 

J —oo 
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• Terms of order m = 3 similarly lead to 
where 



2b m 
-jxF x Z® , 



Z (3) = e -f3t ^ ^ _ 



(12) 
(13) 



• Terms of order m = 4 give 



where 



4 4) = * Z^dt^ , and = e"* * Z^dt . (15) 



(4) 



Terms of order m = 5 give 
2a6 



+ 



(5) 



/3 /3 2 
/ Aabx 8ab 2 x 3 



6ab 2 3 (5) 2afrr 
a; ^ x ^3 







F x F y zf (16) 



V /? 2 



(5) 4ate (5) 
r^^l — r^r^Zjo 



P 



where 



zi 5) = e- fit *dW 1 (=Z^) , 
Z® = e-**Z<®dt, 



^(5) 



X ± yZJ% ) 



e-^*Z^ 4) dWi, (17) 



Zi 5) = e- f3t *Z^zWdt. 



Clearly this procedure may be continued indefinitely to derive, in principle, 
arbitrarily high-order asymptotic approximations to the stochastically forced 
centre manifold. 

After substituting the approximate y = h(t, x) into the x equation, we 
get the following stochastic evolution equation, accurate to 6th order in 5: 



dx 



F x dW l + 
2aab 



ab 



<\x -x 3 — aFyZ^x 



P 



+ 



lab 

T 



F r Z^x 2 



+ 
+ 



r 3 _ 2a 2 & 2 5 _ 2a 2 & (4) 3 _ *ab 2 (4) " 



2aab 



P 
4aab 



F x zfx 2 + 



6a 2 b 2 



F 7( 5 ) T 4 , 



2a 2 b 



F X Fy Z £ X 



(18) 



8a 2 b 2 A (5) Aa 2 b (5) 2 

— -x + —^-F x F y Z\ >x 



P 3 



P 



dt. 



Chao & Roberts 



15 July, 1996 



8 



This last SDE describes the low-dimensional evolution relevant to the noisy 
pitchfork bifurcation. As mentioned earlier, these results are identical to 
those of Schoner & Haken []20], Eq.(5.15)], but the derivation is shorn of 
unnecessary complicating detail and in the framework of the more powerful 
centre manifold approach. 



3 Simplify the noise processes 

One of the remarkable features of the preceding analysis is the appearance 
of many noise processes in the low- dimensional model flT%|). In this example 
there are 8 new noises up to fifth order; in interesting physical examples 
there would be many more corresponding to each of the neglected transient 
modes (see (28-29) in || for example). Further, each of these noise processes 
involves a memory, they are each a convolution integral over the past history 
of a noise source. In the context of simply forced dynamical systems, Cox Sz 
Roberts @ showed how to adapt the centre manifold procedure to eliminate 
the memory effect and consequently simplify the forcing in low- dimensional 
models; however, the analysis was only linear in the amplitude of the forcing. 
In a similar spirit, Coullet et al H and later Sri Namachchivaya & Lin |T5 



examined additive and linearly-multiplicative noise, using the normal form 
transformation to limit the complexity of not only the deterministic terms, 
but also to simplify the noise on the centre and the stable manifolds. 

In this section we show that the approach of Cox & Roberts |7j], in con- 
junction with new ideas on the removal of resonant stochastic terms, leads 
directly to a simple model on the centre manifold; thus simplifying the meth- 
ods and results compared with those obtainable with the methods of previous 
authors. The two critical steps are to allow some flexibility in the parame- 
terization of the centre manifold and to examine the stochastic resonances 
directly rather than in Fourier space. In doing so, as discussed in 0, we im- 
plicitly cater for the nature of the evolution near to the centre manifold and 
consequently discover how to treat the stochastic forcing in a simple manner. 
Again we introduce the ideas as applied to the simple system ([l|-[2|). 

3.1 Reparameterise the centre manifold 

Assume the centre manifold is described by 

x = s + £(t,s), (19) 
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y = v(t,s), (20) 

ds = g{t,s)=g {t,s)dt + g 1 {t,s)dW 1 + g 2 {t,s)dW 2 , (21) 

where s parameterizes the centre manifold and hence s(t) describes the evo- 
lution of the low- dimensional model. Note that ( |19"D is a near identity trans- 
formation of x and we use the flexibility in £ to eliminate as far as possible 
unnecessary noise. The analysis is in the spirit of normal forms; however, 
here we directly construct a normal form on the centre manifold without go- 
ing through the laborious task of finding a normal form of the entire system. 
Substitute ( p(f) and ( |19|) into the y and x evolution equations, (||) and ([[]), 
to get: 

dy = ^dt + ^-ds = \-(3rj + b(s + £) 2 1 dt + F y dW 2 , (22) 



dt ds 

dx = ^-dt + ( 1 + ^ ]ds = [as + a£ - a(s + €)rj\ dt + F x dW x , (23) 
at \ as 



and hence, using (f2~T|), 



Br] = b(s 2 + 2s£ + i 2 )dt + F y dW 2 - ^g , (24) 
g = ——dt — —g+[as + a£, — asr) — a£r)\dt + F x dWx. (25) 

C/ v KJ O 

Substitute the asymptotic expansions 

jj ^ ^(2) _|_ ^(3) _|_ ^(4) _| ^ 

e ~ e (2) + e (3) + e (4) + • • • , 

where, as before, the superscript ^ denotes quantities of order n in 8 (note 
that s = 0{8)). After comparison of the order of the terms appearing in 
fl24| ) and ([25]), we obtain the following equations and their solution. 



3.2 Order 2: simple resonance 

Terms of order m = 2 give: 

d£ (2) 

= fe 2 dt + F^dWa , and g {2) = dt + F x dW x . (26) 
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It is not reasonable to use the freedom in ^ to eliminate dW\ in g^ 2 ' in 
order to simplify the model sde ds = g, therefore 

e (2) = 0, v (2) = ~ p s 2 + FyZW , and g^ = F x dW 1 , (27) 

where Z^> = e _/3t * dW2 as in (|TTj). If one attempts to use ^ 2 > to eliminate 
the noise F x dWi, then one is lead to £( 2 ) = W± which over long-times grows 
like t x l 2 . Such secular growth, albeit stochastic, leads to an unallowable 
non-uniform convergence in time: eventually ^ would no longer be a small 
perturbation to the leading-order term in x = s+£(t, s). Thus the component 
in dWi must remain in g. This sort of direct argument about long-time 
behaviour, rather than resonance in Fourier space, determines which terms we 
may eliminate through the reparameterization (normal form transformation) 
of the centre manifold. 



3.3 Order 3: coloured noise 

Terms of order m = 3 lead to: 

B?7 (3) = - 2 ± sFx dW x , and g^ = ( as -^s 3 - ^ - asF v Z®) dt . 
13 \ (3 dt ■ J 

£( 3 ) cannot be used to eliminate either the as nor the s 3 terms as they have 
non-zero mean (over t, keeping s constant), and hence would generate secular 

growth if they were included in Also, we would like § ( } +asF y Z^ = 0, 
namely = —asF y f Z^dt, in order to simplify the above equation for g^; 
however, this is not possible as we now explain. From (|TT|) , the coloured noise 
Z^ satisfies the SDE 

dZ {2) = -[3Z (2) dt + dW 2 • (28) 

Thus over long-times, on the time-scales we are interested in for the low- 
dimensional model, namely those that are much longer than 1//3, Z^ = 
Oit- 1 ' 2 ) as dt = 0(t) and dW 2 = Oft 1 / 2 ). Consequently, J Z®dt = 

O (t 1 / 2 ^ is unallowably secular, and hence it would appear, as in || [13| , that 

the Z^dt noise must remain in the model SDE ds = g. 

Nonetheless, as in the analysis of deterministic forced systems by Cox & 
Roberts 0, we can usefully simplify the model SDE by removing the "colour" 
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of the noise, that is we avoid the memory intrinsic to and processes like 
it. But first a digression. 

One of the benefits of only considering the dynamics on the centre man- 
ifold, apart from its low-dimensionality, is that often the evolution is intrin- 
sically slow; and even when the evolution is characterised by fast oscillation, 
as in a Hopf bifurcation || for example, a normal form transformation ren- 
ders the evolution in terms of slowly- varying amplitudes. Thus we expect to 
only focus our attention on the long-time scales of the model — for example, 
one may take long time-steps in a numerical solution — and we do not need 
to resolve any details of the rapidly decaying transients. But the form of 
the evolution (|i~8D on the stochastic centre manifold involves noise processes 
ZM(t) which are coloured on the fast-time scale of the decaying transients. 
This can be seen clearly in (|28|) , and similarly for the other noises introduced 
in the previous section. Here each noise process is dominated by the decay 
on the fast-time scale of l/j3. Precisely the same effect can be seen in the 



normal form results of Sri Namachchivaya |13], Eqs. (14-15) in general and 
Eq.(39) in particular, where the noise on the centre manifold modes, U cs in 
general, decays according to the linearised operator of the decaying modes. 
It is also seen in Eq.(29) of Coullet et al |J. However, the latter also point 
out that on the long-time scales of the model, a coloured noise may be ap- 
proximated by a white noise, here Z^dt ~ dW 2 / P- a result easily identified 
from a balance of terms in ([28|). We now proceed to show how to turn this 
simplifying approximation into an exact result. 
Rewrite the sde (|28|) for Z (2) in the form 



d (3 + (3 ' 

whence it follows that we can replace Z^dt by the above in the right-hand 
side of the equation for to obtain 



dt-f t dt+ ^sFydZ® - a -sF y dW 2 . 



Now the term in dZ^ can be absorbed into leaving just the white noise 
dW 2 in g (3) for the model SDE. Thus 

£( 3 ) = ±sF y Z^ , r/ 3 ) = -f sF x Z^) , 
and = (as - fs 3 ) dt - ±sF y dW 2 , (29) 
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where = e 131 * dWi as before in ([13]). 

In summary, to third order we deduce the centre manifold is 

x ~ s + ^sF y Z^, 
P 

y - b -s* + F y zV-^sF x z^, 

s.t. ds ~ (as- ^-s 3 ) dt + F x dW x - %sF v dW 2 . 



P J 



This is an exact decomposition: to this order we have put all the "colour" into 
the description of the location and shape of the stochastically forced centre 
manifold, leaving just pure white noise in the model evolution equation. 



3.4 Order 4: nonlinearly generated noise 

Equating terms of order m = 4 in (f24|-|2~5|) give: 



B4 A) = 2 ^s 2 F y Z^dt-'^s(as-^s s ]dt + ^F 2 Z^dW 1 

P P V P ) P ' 



+^-s 2 F y dW 2 , 



2ab 

J 2 

S (4) = -f 4) rft-> I F/'^i + ^ 2 F*. 



dt p y p 2 

The terms to the right of are resonant, dW\ = O (^ 2 ) and Z^dW\ = 
O (t°), so that at least some component of these noises has to be assigned to 
At this stage we cannot think of a useful transformation of the Z^dW\ 
contribution, and so must choose 

£ {4) = , and thus 

9 {4) = + 2 ^s 2 F x dW 1 -^F x F y Z^dW 1 , 
where z{ 4) = e~ pt * Z^dW l and Z^ ] = e~ pt * Z®dt as before, (0). 
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A prime target for further research is to simplify the nonlinear combina- 
tion of Z^dWi] the difficulty is that this is not a normal coloured noise term. 
Its presence here shows that the typical assumption of Gaussian noise is gen- 
erally not justified in modelling nonlinear dynamics. However, in the next 
section we outline a Fokker-Planck approach to the rational simplification of 
such nonlinear noise processes. 



3.5 Order 5: noise induced drift 



Terms of order m = 5 lead to: 

B V {5) = j{as-^)F x Z^dt- 2 ^sF x F y Z^dW, 



+ 



7 (5) 



Ab 3ab 2 Aab 

W s{a -— S) ~T 
d ^dt 

dt p - " - p 

2ab - /a\ , a 2 „ „/^^2 , Aab 



—sF Z® 



s^ dt _ 2 -^s 5 dt - 2 -^s*F v ( ZP + -Z^\ dt 



F x dW l 
1 

Tr 



, sFlZ^dt ~ jsF^dt + ^-sF^dW, + j 2 sF 2 Z^dW 2 . 

As before we use £® to absorb as much of the evolution terms in g( 5 \ Recall 
that Z^dt = -\dZV) + UW 2 , so that 



Z®*dt = (z™dt 



l d(zw 2 



2/3 



Z^dW* 



whereas from (|T5|) 



Zfdt = 

Z[ 4) dt = 

Thus we set 

2a 2 b 



-dzf + -Z^dt = --dzf - l-M 2) + 4dW: 















2 



2 



Idzi^lz^. 



s 3 F 

(3 2 y 



lab 



4 4) + ) + ^sF 2 x Z^ + ^sFfzW 







ft 2 



2b 
J 



as 



3ab 



( 2aab o 

9 = h^ s 



2o^ 2 

~J 3 



F, [zf + ±*<" 
s 5 ) dt 



Aab 
~0 



-sF x F y Z 2 



(5) 



2ab 







2 sF x F y Z^ , 



^s 3 F y dW 2 + ^sF^dW, , (31) 
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where the new noise 

dzf ] = e-* * (z^dW x + Z^dW 2 ) . (32) 

A factor of interest in g® is the non- Gaussian noise Z®dW\ which has non- 
zero mean and predicts a long-term "drift" in the low-dimensional model of 
the order of the square of the stochastic forcing. This term, being linearly 
multiplicative in s will contribute to a destabilisation of the origin. 



3.6 Asymptotic model 

Therefore, we obtain ds to fifth order as follows: 



ds ~ I as — — s 3 



ab 

J 
2ab 



2aab 



2 1,2 



s 3 - 



2a>h 
~J 3 



+ 1 + — s 1 F x dW l -\^s + 



j dt 

Aa 2 b 



0' 



P P 3 



s 3 RAW, 



(33) 



-^FyZ^dW, + ^sF 2 Z^dW 1 



This has significantly simpler structure than the fifth order version of Schoner 
& Haken that we derived in the previous section, namely (|I8D truncated to 



dx 



F x dW x + 
2aab 



ax — x 3 — aFyZ^x 

P 



+ 







o 2a 2 b 2 , 2a 2 b 

rf^ ^ J 



+ 

(4)^3 



^F^x* 



P 



2ab 
2ab 

T 



dt. 



There are only two new noise processes in the model, instead of four, and the 
two noises which are new are obtained from lower order SDEs. Instead we 
see in ([33]) a richer structure directly in terms of the noise from the original 
system. 



4 Fokker-Planck analysis of nonlinear noise 

In this section we turn to the appearance of the noise processes Z^dW\ and 
Z^dW\ in the low- dimensional model fl3"3"|). The computation of Z® and 
, via the convolutions in ([TT|) and ([13|) , necessarily takes place on the fast 
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time-scale 1/(3, and must therefore be a major hindrance to the use of the 
model over long times. Such fast time-scales in the noise are not apparent 
in the centre manifold analysis of Fokker-Planck equations by Knobloch & 



Wiesenfeld ||10|| . In a pitchfork bifurcation, for example, the evolution on the 
centre manifold of a Fokker-Planck equation |L0|, Eq.(3.22)] is equivalent to 
the stochastic differential equation 



du = [fiu + au ) dt + ad^ 



where d^{t) represents Gaussian white noise. In simpler systems one can 
carry out an analysis of the Fokker-Planck equations to high order and see 
that while the effective noise may be non-Gaussian, there is no remnant of the 
fast time-scale. We show this here, and then suggest how to model Z^dW\ 
and Z^dW x . 

We propose to replace these nonlinearly generated noises with new inde- 
pendent Wiener processes with the same long-term statistics. In essence we 
construct a weak low-dimensional model by these arguments — fidelity with 
the original dynamics can only be assured via the undesired evaluation of 
fast-time integrals. 



4.1 Self excited drift 

In the sde (|33|), we would like to replace the factor Z^dW± by a dw where dw 
represents some simple noise process which could be sampled over relatively 
large times. That is, using the definition of Z^\ we seek to understand 
something of the evolution of w(t) in 

dw = Z {3) dW r , dZ (3) = ~{3Z (3) dt + dW x . 

This is in the form of a SDE with one neutral mode w and one exponentially 
decaying mode Z^ . Thus we may apply centre manifold techniques to derive 
a model SDE for the mode w(t). However, if this is done using the techniques 
described earlier, then one finds exactly the same type of noise process in 
the results. The above pair of coupled SDEs is in some sense canonical in 
that it is irreducible using the previous techniques. Instead we turn to the 
Fokker-Planck equation; we must do something different because the results, 
equation (0), involve the surd v7? which is impossible to obtain via the 
direct application of the algebra of centre manifold techniques. 
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For convenience we rewrite the SDE as 

dx = eydWx , dy = -(3ydt + edW x , (34) 

where, in this subsection only, x = w and y = . The "small" parameter e 
has been introduced to order the terms in the asymptotic analysis; eventually 
we set e = 1 to recover approximate results for the original process. The 
Fokker-Planck equation of this Stratonovich SDE is 

e 2 e 2 
d t u = —d x u + (3d y (yu) + — [y 2 d xx u + 2d xy (yu) + d yy u} , (35) 

for the probability density function u(x,y,t). We seek a model for the long- 
term evolution of x(t) via the derivation of a Fokker-Planck equation for the 
probability density function 



p(x,t) = / u(x,y,t) dy. (36) 

J — oo 

Heuristically, the term (3d y (yu) in fl3"5p concentrates u upon y = 0, but this is 



countered by the noise induced diffusion term ^-d yy u. Thus to leading order, 
u is Gaussian in y — but very localised if e is small. Then the other terms 
in the Fokker-Planck equation cause a long-term drift and spread in the x 
direction which we describe in terms of p(x,t). 

We use centre manifold techniques to find the long-term evolution of p. 
Because of the symmetry and simplicity of (^) we can analyse the Fokker- 
Planck equation somewhat more straightforwardly than Knob loch & Wiesen- 
feld [0. First, scale 

y = eY, u = -U(x,Y,t), 
e 

so that with Y we can resolve the Gaussian structure, and any modifications, 
in y. Then seek 

oo 

U = V(Y,p)^^e n V^(Y,p), (37) 



n=0 

oo 



such that d t p = g(p) ~ 5>V n) (p)- (38) 

n=0 
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Substituting these into (f^) and (|36|) gives a hierarchy of equations to solve 
for and g^ n \ Using computer algebra it is straight-forward to find 

U ~ G(Y> 

+e 2 (-Y 2 + G(Y)p x (39) 

e 2 

such that ~ - —p x + jnPxx - jTpPxxx , (40) 




where G(Y) = yP/n exp (— (3Y 2 ) is the leading-order Gaussian structure. 

This last evolution equation (fE]), when truncated to neglect terms o (e 4 ), 
is the Fokker-Planck equation of a SDE such as 



e 2 , e 2 



dx ^_ dt + —dW, (41) 

where the noise process dW may be considered essentially independent of 
the original noise dW\ because, on the long-time scales that we wish to use 
these noises, the nonlinear process generating x(t) summarises quite different 
information about the details of dW\ than that of the simple cumulative 
sum seen in Wi(t). This is confirmed by numerical simulations. Figure 
shows that, on time scales long compared with the decay time 1/(3, there is 
virtually no linear correlation between the noises dW\ and dx — dt/2; there 
are nonlinear correlations for smaller times, e.g. At = 2/(3, but these slowly 
disappear, as seen for At = 16//3. Thus we propose to replace, in the low- 
dimensional model (|33|), the fast time-scale factors Z^dWi by the above 
dx for e = 1, namely by \dt + ^dW 3 /y//3 where W 3 is a new independent 
Wiener process. In essence, this replacement summarises the drift and overall 
fluctuations in Z^dWi while ignoring the other details of the nonlinear noise. 

There are two issues to comment on. Firstly, it is reasonable to trun- 
cate PD| ) to the first two terms because this is the lowest order structurally 
stable approximation to the evolution of p(x,t). Further, although there are 
higher-order modifications, it is apparent that g( 2n ) = O {(3 l ~ n ) so that, pro- 
vided the decay of the "slaved" modes are rapid enough, these higher-order 
terms may be neglected while maintaining accuracy. 
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Figure 1: scatter plots of A(x—t/2) versus AWi on two time-scales: left-hand 
plot for At = 2/(3; right-hand plot for At = 16//3. The data is generated by 
public domain software, Gnans, numerically integrating fl34T) over < t < 
10, 000 with a time-step of 0.01. 

Secondly, strictly speaking the asymptotic expansion (^) is not uniformly 
valid and so could be in error; it is evident that oc Y n G(Y) and so 
> for large enough \Y\. However, instead of solving for all Y we 

may restrict analysis to \Y\ < ^ — O (e -1 / 2 ), that is \y\ = O (y/e), then 

• the errors in doing this are typically O (G(^)) = O (exp(— /3/e)), namely 
exponentially small; 

• and for large Y < at worst 

y(n+l) = q ^ V ^) which preserves 
the ordering of the asymptotic terms. 

Consequently, the above expansion is asymptotically valid. 
4.2 Independent jittering 

Similarly, in the SDE (^), we would like to replace the factor Z^dW\ by a 
dw where 

dw = Z {2) dW! , dZ {2) = ~[3Z {2) dt + dW 2 . 

Here the two noise processes, W\ and W2, are independent, thus causing the 
Fokker-Planck equation of this Stratonovich SDE to be the somewhat simpler 

d t u = (3d y {yu) + — {y 2 d xx u + d yy u} , (42) 
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Figure 2: scatter plots on the time-scale At = 2//3: left-hand plot of Ax 
versus AWi; right-hand plot for Ax versus AW^. As before, the data is 
generated by numerical integration over < t < 10, 000 with a time-step of 
0.01. 



where here x = w and y = Z^ 2 \ As before, we seek a model for the long-term 
evolution of x(t) by substituting ( 



381 ) into this equation to find 



U 



G(Y)p 



A 



Y 1 



G(Y) Pa 



(43) 



1 y 4 + J-^Y 2 - 



32/3 



, e e 
such that p t ~ — H „ 

Ft ^Fxx 



32/5 3 ' 

qPxxxx ■ 



12Sp 4 



G{Y)p, x 



(44) 



This last evolution equation, when truncated to neglect terms o(e 4 ), is the 
Fokker-Planck equation of a SDE such as 



dx 



2v^ 



dW A 



(45) 



where the noise process dW^ may be considered essentially independent of 
the other noises dW\, dWi and dW%. Again numerical experiments confirm 
this as seen by the lack of correlations in Figure 0. Here, this is so even 
on the relatively short time-scale of At — 2//3. There is no drift term in 
this SDE; the analysis suggests that over long time-scales we may treat the 
nonlinear noise Z^'dW\ by a white noise ^dW^/y/p. 
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4.3 Simplest, accurate, long-term model 

The preceding analysis suggests that we may write the low-dimensional model 



ds 



ab 9 \ ab , 2aab » 2a 2 b 2 * 

? + p* : )-J* + -0r*—p-*. 

lab „\ „ / a Aa 2 b 



dt 



( 1 + "fs 2 F x dW, - \-s + ^ F y dW 2 (46) 



a 



ab 



;F x F y dW 4 + ~-^sF 2 dW; 



3 



2^3/2 x V 41 ^5/2 

This is the "simplest" model because: 

• firstly, it is low- dimensional (here just one-dimensional instead of the 
original two-dimensions); 

• secondly, it has no fast time-scale processes in it at all — other than those 
we call purely white noises whose long-term behaviour is known — and 
so may be numerically integrated using standard methods || with large 
time steps, ones appropriate to the phenomena of interest rather than 
ones dictated by the rapid time-scale of negligible modes. 

Note that this model is a "weak" model unlike those of the previous sections. 
Previously, long-term fidelity of the model when compared with the original 
trajectories is assured by the algebra of the theory. However, here we have 
resorted, through the Fokker-Planck analysis, to using only broad statistics 
of Z^dWi and Z™dW\ in the resultant model. The short-term details 
of Z^dWi and Z^dWi, which are apparently needed to maintain fidelity, 
have been discarded. However, the processes W\ and W 2 are invoked as noise 
precisely because we do not know their detailed dynamics, and so there is no 
loss in subsequently admitting that we do not know details of Z^dWi and 
Z^dWx. 

Throughout this analysis we have assumed that the original system was 
perturbed by white noise. However, the generalisation to "coloured" noise, 
Ornstein-Uhlenbeck processes, is straightforward, one just adjoins a dynam- 
ical equation describing the evolution of the coloured noise in terms of a new 
white noise. Consequently, we have shown how dynamical systems perturbed 
by even coloured noise may be systematically modelled by a low- dimensional 
system involving purely white noises. 
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On a philosophical level, we see in the process of reduction from (fl|-|2|) to 
(|46| ) how unknown effects, represented by W\ and W2, effectively give rise to 
multiple noises in a mathematical model such as (|46|). Moreover, through the 
nonlinearities, the originally additive unknown processes naturally generate 
multiplicative noises. 



5 Conclusion 

This report has concentrated on a specific toy sde. This is to demonstrate 
how crucial ideas can be developed and threaded together to form a low- 
dimensional modelling paradigm for SDEs in general. By avoiding compli- 
cated generalities we have been able to extend the centre manifold analysis 
to this interesting class of problems. Currently we are using the ideas de- 
scribed herein to investigate physical problems of significant interest. For 
example, we aim to investigate how stochastic effects, such as those due to 
turbulence, affect the dispersion of tracer in channels and pipes. 

The analysis performed here has used the Stratonovich calculus for SDEs. 



As demonstrated by Schoner & Haken [2]J the Ito analysis should produce 
completely equivalent results. 
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